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1.  INTRODUCTION 


Consider  a sequence  Nil}  of  Coupon  collector's  situations 


(1.1)  % = {(aN(l).PN(l))....»(aN(N),PN(N))}  , Nil  , 

r*  N 

where  a^(s)  and  p ^ (s')  (>01  are  real  numbers  and  1s_jP^(-s)  = 1.  Consider 
also  a (double)  sequence  (i^.  ^>1}  of  (row-wise)  independent  and  identi- 
cally distributed  random  variables  ( i . i . d . r . v . ) , where  for  each  N, 


P{,Nk  = s}  = I>N(S)  ’ 1 - s s N • 


[,et  t hen 


aN(INk^ ’ lf  *Nk  * (1N1  ” ‘ - ’ 1 Nk- 1 1 ’ 
0,  otherwise,  for  kil  ; 


Z.,  = T ,Yk,l  . k>l  and  Z.,  =Y=0  . 

Nn  Li=l  Nk  NO  NO 


Then,  is  termed  the  bonus  sum  after  n coupons  in  the  collector's 

situation  12^.  If  the  a^(s)  are  all  non-negative,  Z^n  is  non-decreasing 
in  n(^0),  3nd , for  every  t '0,  let 


II..  (t ) = max  {k  : Z...  < t 
N Nk 


1'hen,  U.,(t)  is  termed  the  waitinq  time  to  obtain  tht'  bonus  sum  t in  the 
N 

coupon  collector’s  situtation  . 

For  an  arbitrary  positive  integer  b and  {n,k ,<...  <n..,}  satisfying 

1 N ON 


_ . lim  int  .,-1  1 lm  sup  .,-1 

0<  N n . < ..  N n. . ,<  00  , 

IN  N-*®’  bN 


under  certain  regularity  conditions. 


Rosen  (1969)  has  established  (by  very  elaborate  analysis)  the  asymptotic 

(mu  1 1 i ) norma  I i t y of  (the  standardized  form  of)  ( Z.  Z.,  };  in  a 

Nn  ’ Nn. 

1 N bN 
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follow  up  ([&!),  he  has  studied  parallel  results  for  U)^}.  The  object  of 
the  present  investigation  is  to  propose  and  formulate  an  alternative  approach 
to  this  problem  based  on  the  weak  convergence  of  a suitably  constructed  mar- 
tingale sequence  associated  with  the  . This  provides  a simpler,  shorter 

and  neater  proof  of  the  aforesaid  normality  and  also  an  invariance  principle 
for  the  partial  sequence  (Z^ » ksn}  as  well  as  for  the  corresponding 
sequence  of  waiting  times.  The  basic  regularity  conditions  are  outlined  in 
Section  2.  Asymptotic  normality  of  Z^  is  established  in  Section  3 with 
the  aid  of  some  recently  developed  martingale  central  limit  theorems,  and 
the  multi-normality  extension  is  presented  in  Section  4.  Section  5 is 
devoted  to  the  (weak)  invariance  principle  for  {Z^ . ksn}  and  allied 
results  for  the  sequence  {U^,  t > 0}  are  studied  in  Section  b.  A few 
remarks  are  made  in  the  concluding  section. 


2.  PRELIMINARY  NOTIONS 


Note  that  by  (1.2)  -(1.4),  for  every  N(M), 

<2-"  V 

<2-21  '~m’° 


Let  us  denote  by 


(2.3) 


♦n„  ■ • "I0  • 
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(.2.4) 


rN 


dNn  = 4=lVs)e 


'nPNlS,(l-e-npN(s')) 


-np  (s)'a 

- ni£s=iaN(s)pN(s)e 


, n > 0 ; 


(2.5)  Anf  = N‘l^=i|aN(s)|r  , for  r*  1,2, 3,4 


We  assume  that 


(2.6) 


SUP/  max  Np  (s)j  < M 
N \l<s<N  1 Nl  Jj  1 


(2.7) 


(2.8) 


1 im  inf 
N-+°° 


/A. 


> M > 0 


Note  that  xe  X < e ' , V x > 0 and  for  0 < x • 1 , (He  nX  - (1  -x)n  ‘ nx^e  nX  . 


Hence,  from  (2.2)  and  (2.3),  we  have 


m -np  (s) 

H’NnAnl  = Hs=laN(s)(S)|c  ‘ -^N^1  1 


-nPM(-s) 


(2.9)  < ^=1|aN(s)|pN(s){npN(s)e  N He'1M]AN]>  V lUfl,  N>1  . 


In  fact,  if  the  aN(s)  are  a11  non-negative  then  ^Nn-^n‘  Also,  noting 


that  e x(l-e  x)<x,  V x'O,  we  obtain  from  (2.4)  that 


7 „N  2 'nPN(s)  'nI’N(s) 


t n'l.  NM  . 

uvn,i.u-.-xiic:i»  > 


Further,  using  the  fact  that  for  O'-  x-  .,  v ■ -«■  < - '/.g-o 


x(l  -*sx)^_Je  ^X,  we  obtain  that  for  N > M j 
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U.ll,  .(l-^N^M  )Xj:Jh;=ia“lS)p N(s)e 


. . -tn+k)PN(s)  rN  , . , . -nPN(5)l2l 

(s)e  -[4=iaN(s)pN(s)c 

-(n+k)p  (s)  -(n-k)p  (s) 

[ 1-e 


-(2n-l)M  /2N 

ni-'.N  Mjle 


|(n-l)/2|^=1a“(s)pN(s)[l-c 


•Vi(n+l)pNCs) 


Now,  by  (2.6),  (2.7)  and  (2.8),  A^{s:p  (s)>e/N}a“(s)pN(s)  “ N^s=laN(s)PNts)  "E 

->i(n+l)p  (s) 

Vc>0,  and  noting  that  for  p^(s)  > c/N  and  n/N>n>0,  1-e  1 5 c(e,n)>0, 

we  obtain  from  (2.11)  that  if 


(2. 12) 


„ , lim  inf  .,-1  lim  sup  .,-1 
0 < ,,  N n s „ 1 N n 

NJ-xx)  N"*00 


then  1 in<  (d"  /nA  , ) > 0.  Thus,  we  have 
N-*00  Nn  N2 


(2.13) 


0 < 


im  inf  (d2  /n,\  ) < lim  SI,P  (d2  /nA  ) < oo  , 

N-~*>  luNn  N2  N-+<»  1 Nn  N2 


when  (2 . 6) - (2 . 8)  and  (2.12)  hold. 

We  are  primarily  concerned  here  with  the  limiting  behavior  of  the  partial 
sequence  dN ~ 1 ^Z|sjk_<^Nk  ’ k - • Since  d^aN(s) , l^s  N remain  invariant  under 

any  scalar  multiplication,  we  may  without  any  loss  of  generality  set 


(2.14)  A - = N ljN  . a“(s)  ~ 1 , for  every  N . 

N2  t,s=l  N 

Then,  by  (2.9),  (2.13)  and  (2.14),  we  have  I ^ so  tl,at  ’ 

we  may  equivalently  consider  the  partial  sequence  d^*(  • k‘  n'-  *"  t*’° 

remaining  of  this  section,  we  consider  a basic  lemma,  to  be  used  repeatedly  in 
subsequent  sections,  bet  = p^t  1 N^1  , k s I and  let  SNu^Nk’^Nk^’ 

ti  = 1 p(  -2)  be  such  that 


(2.13) 


max 


ma  x 


1-  u-  pi  1 s N^Nu(aN(s)  ,PN(S)  ’ 


N , 3 


SUP  M 
N N , 3 
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(2‘lb)  l<Sp{illgNu(aN(s)'PN(s))|}"MN(4’  T N‘1mN(4<0°  ' 

Note  that  (2.15)  and  (2.16)  insure  that 

(2'17)  l<uTu%p{Cl,8Nu/aN(s)’PN(S)8Nu?(aN(S)’PN(s))l} 


< where  M,,  r < M„  „M. 


N,5  N , 3 N , 4 ' 


Lemma  2.1.  Under  (2.6),  (2.15)  and  (2.16),  for  every  0 = < . 


. < V < n 
P 


(2.18) 


'TT^Nu^Nv  ’°'NV  1 y*‘gNu ^ Nv  '%v  1 
U=1  U U U=1  u u 

*°IN'1mn'4[MN,3VN"1mn,41) 


(2.W)  CovIg^lY^.Q^l.B^fV^.Q^n.OCN^^^vN-1^^],  , 

,2-20>  V‘<!»1(VNV1-%1)I-0(IN'1mN,51a|(N'1hn,4)21>  • 


Proof.  We  shall  only  prove  (2.18);  the  others  follow  by  similar  arguments. 
Note  that 

P 


eTTWynv  ,QNv  ] ^ 

u=l  u u l<s , *■ . . . *s  <N 

1 P 


H^Nu^N 

u=l  ' 


D-  l pN(sk0 


V -V  -1 
u u-1 


k = u 


(2.21)  = 


I 


, * M ^[{gNu(aN(Su)’PN(Su))PN(Su)c  U'N  “ lI+0{N'1)] 

l<s,  *.  . .*s  <H  u=  1 *■ 

1 P 

. ^ „ ^[{*Nu(aN(su)pN(su))pN(su)e  U'Ni  U 

l<s, *.  . . <s  <N  u=l ' > 

1 P 


(by  ( 


. ■ • ,p)  . 


I 


2.6)) 


by  (2.6)  and  (2.16).  Similarly,  for  each  u(=  1 
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<2-22>  e%„‘ykv  -V  W‘’*w'V4' 

u u 


where,  by  (2.6)  and  (2.16),  the  first  term  on  the  right  hand  side  of  (2.22) 

is  0(N_1M^  ^)  . The  product  of  the  p factors  of  the  first  erm  in  (2.22) 

involves  NP  terms  where  as  (2.21)  involves  terms;  by  (2.15)  and 

(2.16),  the  contribution  of  these  NP-N^  terms  is  0(M..  *MP  P ) . 

N , 3 N ,4 

Hence,  the  proof  follows  from  (2 . 2 1 ) - (2 . 22) . For  p = 2,  NP  - N P =N 

t-N  2 ^V]+V2^PN^S^  -2 

and  Is=lgNl(aN(s),PN(s))gN2(aN(s),PN(s))PNCs)e  = °(N  }’ 

S=llgNl(aN(s),pN(s))gN2(aN(s)’PN(s))'j  = °lN’“ ‘MN .S3 ’ 50  that  (2‘19) 

follows  on  parallel  lines.  Q.F.D. 


3.  ASYMPTOTIC  NORMALITY  OF  {d"1(ZM  -<b  )} 

Nn  Nn  Nil 

The  main  theorem  of  this  section  if  the  following. 

Theorem  3.1.  Under  (2.6)-(2.8)  and  (2.12), 

(3..)  * N(0-,)  ■ 

Proof.  Unlike  the  approaches  of  Baum  and  Billingley  (1965)  and  Rosen 
(1969,  1970),  our  proof  rests  on  a construction  of  a (triangular  array  of) 
martingales  related  to  {Z^}.  Let  8^  be  the  sigma-field  generated  by 


(Y., . , 
Nj 

j < k } , k > 1 , 

and  let  6,^ 

be  tlic  trivial  signma 

-field. 

Tlien , for 

every 

N,  eNk  is 

non -decreasing . 

For  every  N,  n(^l), 

we  define 

(3.2) 

X*-n^  = Y (1 
Nk  1 Nk  1 

n ik-l  "nQNk 
+QNk}  C 

' qNk  = >W  • k 1 

v(n) 

’ NO 

= 0 , 

(3.3) 

t- (n)  . vN 
sNk  ^s=  1 

■”PN 

aN(s)pN(s)e 

(S)  k-1 

1 1+PN(S1 1 , k 1 

r (n) 
’ ‘’NO 

= o , 

-8- 


and  consider  the  sequence 


‘3-<> 


' (C'  • O * l A"' % (l*q  >k~\  k>i;  5'"1  .0 

Nk  Nk  *-v=0  Nv  xNv  xNv  ^o 


Then,  on  denoting  by 


‘3-s>  k'°  a,,j  • t2°’ 

we  obtain  from  (3.2)-(3.5)  that 

, i k]  -np  (s) 

(3. fa)  Sjk  =4=laN(s)e  Ul+PN(s)]k  - 1}  , k > 0 ; 

>3-7'  nQ'<T(i*<!m)k-QN1(i.QNili-1|  , uo, 

(5.8)  ^mXk-l’  ■ 5Nkl,  • V kS1  • 

so  that  for  every  N,  n(5l),  , B k5  0}  is  a martingale.  From 

(2. fa)  and  (3.6),  it  readily  follows  that 

(3.9)  ^Nn^NbJ  = ’ for  ever>r  N’n  • 

* -nQ  . 

Also,  note^  that  I Y^.e  Nl  d+QNi) 1_1 1 *Fi  = l 1 YNi  |Qnj  * l"=1  |aN(s)  |pN(s) 

s MjiA^7~Mji,  by  (2. fa)  and  (2.14),  while  for  x e (0,1),  l>e  nx  (l+x)°  ? 1 -nx“ , 

so  that  under  (2.6)  and  (2.12),  we  have  from  (3.7)  that  js^n--Z„  +<!,,  I is 

‘ Nn  Nn  Nn 

bounded,  with  probability  one.  Thus,  by  (2.13),  (2.14)  and  the  above,  we 
conclude  that  for  every  e>0,  there  exists  an  N^ft),  such  that  under 
(2.6) -(2.8)  and  (2.12), 


P { d " 1 I s^(n ' -Z-,  I >c)  = 0 , V N"W„(C) 
Nn  1 Nn  Nn  Nn'  0 


(3.10) 


Consequently,  it  suffices  to  show  that  under  (2.6)-(2.8)  and  (2.12), 


(3.11) 


L'dN^n)> 


Now,  for  the  martingale-difference  array  {d./xf.?^ ; k<n},  by  (3.4), 

Nn  N K 


(3.12) 


isk'n’ 


(n) 


k-1. 


where  |^k  I - Ts=\ I 3n I PN ' M1/Vl2  ~ M1‘  Also>  I YNk I ~ l<s<N  ^ aN^  I 


0 (N 2)  = 0(dNn),  by  (2.7),  (2.13)  and  (2.14).  Finally, 


yk- 1 | y iq 

^V=  1 * Nv 


Nv 


N i i i-5  1 

• j (s  J I ?n  (s)  - ~ , V k>l.  Hence,  for  every  £>0,  there  exists 


an  W()(e),  such  that 


(3.13) 


p|,™?!Ld“hxilti")  I > e|  = 0 , V N>N0(e)  ; 


|l<k<n  Nn 1 Nk 


the  above  equation  also  insures  that 

(3.14)  ,mfX  d./|xf.P^|  is  uniformly  bounded  in  L,  norm  . 

l<ksn  Nn 1 Nk  ' 2 

Further,  by  (3.4)-(3.8),  F([sf,n^|“)  = J?  , E ( [ X^  ] “ ) , and  some  routine 

Nn  K - 1 NK 

steps  leads  us  to 

(3.15)  dNnE([SlSn)]2)  " 1 as  N - °° 


Thus,  by  virtue  of  (3 . 13) - (3 . 15)  and  (3.8),  we  are  in  a position  to  use 
the  recently  developed  central  limit  theoresm  by  Dvoretzky  (1972),  Scott 
(1973)  and  Mcl.eish  (1974),  and  to  prove  (3.11),  it  suffices  to  show  that 


0 , 


(3.16) 


-2fyN  [£(nl  n) 

NnlAk=l  1 Nk  1 Nk  ’ 1 


(3.17,  £)->cii!£Viw-v‘iK,i<Nl,i> 


(")  Ir 


= 4=iaN(s)l’N(s)e 

-Jk-‘y2g  o'2"'!ku 
Lv=\  NvvNv 

- (c^  - yk_1Y  Q 

^Nk  LV=l  Nv^Nv 


-2npN(s)fl  f . ,2(k-l) 

n+iys)j 


(1+V 


2(k-l) 


'n(^N  k - 1 2 

/ V^1+v  ) * k21  • 


By  steps  similar  to  those  after  (3,12),  it  follows  that  the  are 

Nk 

-2  -1 

ail  hounded  with  probability  1,  while,  by  (2. 13) - (2 , 14 ) , d = 0(n  ). 

Nn 

Hence,  to  prove  (3.16),  it  suffices  to  show  that 


(3.18) 


max  |Cov(£(n)  £(n,|  - 0 as  n - « 
lsksqsn1  1 Nk  ’ Nq  1 U aS  n 


? “"VNV  2fk-ll  'My  k-1 

Defining  8NuO'Nv.QNv)  as  VKhlQMx,e  d+QMJ  (or  V^.Q^.e  ' (J+QMJ  ) 


Nv  Nv 


Nv  Nv 


it  readily  follows  that  (2 . 15)  - (2 . 16)  hold  with  M =0(1)  (or  0(N  2)  and 

!\  , .7 

Mn  ^ ~ M (or  Mj) , and  hence,  (3.18)  can  he  proved  directly  by  repeated  use  of 
(2  . 18)  - (2 . 20)  for  the  individual  terms  in  the  expansion  of  by  (-3.12). 

Q . F. . D . 

We  may  remark  that  intuitively  one  may  attempt  to  work  with  the  alterna- 
tive construction:  Y.„  = Y.„  - F.  (Y„,  1 8,„  ,),  k^  1,  Y„  = 0.  Then,  one  would  have 

Nk  Nk  Nk ' Nk-1  NO 

<319>  ?n„  ■ S.DNk  * iH=i{vNk  'S=iaN(s)pN(3)  * i‘:lvNvQNv) 


NV  Nv  ' NV  Nv1 


Whereas  the  asymptotic  normality  of  d^^'2^^  may  he  proved  along  the  same 

lines  as  in  the  second  term  on  the  right  hand  side  of  (.3.19)  is  not 

1 

generally  o^n1*),  so  that  this  particular  construction  may  not  be  very 

helpful  for  the  desired  normality  of  d,*(Z,,  -6,,  ). 

' Nn  Nn  Nn 
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4.  CONVERGENCE  OF  FINITE  DIMENSIONAL  DISTRIBUTIONS 


For  an  arbitrary  positive  integer  b,  consider  a sequence  of  posi- 


tive integers  {n  < . . . < n^l  where 


(4.1) 


„ lim  inf  - 1 „ lim  sup.  -1 

0 < ..  ^ N n...  < __  kN  n,  ..  < 00 

N -»•  oo  IN  N 00  bN 


We  are  basically  interested  in  the  asymptotic  multinormality  of 

('4-2)  N 'ZNn  ‘‘Vi  ZNn  “^Nn.J  ’ 

IN  IN  bn  bN 

when  (2.6) -(2.8)  and  (4.1)  hold,  and  we  impose  (2.14)  without  any  loss  of 
generality.  Let  us  define  IN  = ( (°kq>N) \ >q=1 , . . . >b  by 

VV  , k=q (=  1 ....  ,b) 

IN 

nkN 


°kq,N  = ' 


(4.3) 


-nVMPM(s) 


-1VN  2 . . qNl  N ’ ,,  kN' N' 
N ).s=1aN(s)e 


(1-e 


.,-1 

-\  n 


kN 


£s=iaN(s)PN(s)e 


nkNPN(S) 


) 


rN  ( ( , -nqNPN(S) 

^s=laN(s)pN(5)e 


1 < k < q < b , 


tV.N’  • 


Recalling  that  a vector  L^  is  ~ \(PN*IN>  if  for  every  A*0,  A'  ^n’~n' 

is  ~ N,  (O.X'LX)  , we  have  the  following. 

1 ~IN~ 


Theorem  4.1.  Under  (2. 6) -(2. 8)  and  (4.1) 


-*Nn.  • 1 J »'>  * “h '5'In> 

|N  jN 


(4.4) 
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l’roof. 


Define 


*(n)  ~(n) 

Nk  ’ Nk  ’ 


k > 0, 


as  in  Section  3, 


Let  then 


14.5) 


>(n) 

Nk 


<00 

Nk 


0 < k < n 


k > n 


$ (n)  vk  o (n) 
Nk  ^V=0  N 


k > 0 . 


Note  that  = sf[^  for  k<n  and  sf.?^  = s}.n^  for  k>n.  Thus,  pro- 

Nk  Nk  Nk  Nn  ’ ‘ 

ceeding  as  in  (3 .9) - (3. 10) , under  (4.1),  it  suffices  to  show  that 

-i.  JnjN)  . r 

N (S  J , 1 < j < b)  is  ~ Nb(04N) . For  this  purpose,  consider  an 
njN 

arbitrary  linear  compound  (where  A * 0) 


(4.0) 


l , A . N JN  = 
L)  = 1 J NnjN 


t . A . X 
^k=l  L}=\  j 


. Cn  ; 


‘ Nk 


JN' 


) = N 


bN~* 
H=1  Nk 


say 


* vb  iN' 

where  X^  = ^j-l^jXNk  ' k>l.  Note  that  by  (3.2),  (3.4)  and  (4.5), 
E(XNk|8Nk-l}  =0>  V kSl’  and’  we  may  virtually  repeat  the  proof  of  Theorem 
3.1  [viz.,  (3. 12) - (3. 18) ] with  being  replaced  by  X*^ ; the  details 


are  om i t ted . Q . E . D . 


The  prescribed  martingale  approach  provides  a solution,  considerably 
shorter  and  neater  than  the  one  given  in  Rosen  (1909). 


5.  AN  INVARIANCE.  PRINCIPLE:  FOR  Till.  BONUS  SUM  PROCESS 


For  an  arbitrary  T(0<T<°°),  let  J = [0,T]  , and  for  0 x y < T, 
define 

-lrN  2 -NxVs)  -NxPN(s) 

Vx,y)=N  £s=lVS)C  |Ue  1 


„N 

Is=iaN(s)pN(s)c 


^s=iaNls)PN(s)' 


-NypN ( s 


(5.1) 


X 
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and  let  Y„  (x,y)  = y»,(y  .*)  for  Osy<x<T.  Proceeding  as  in  (2 . 10)  - (2 . 1 1 ) , 

N N 

it  can  be  shown  that  Y„tx,y)  is  (uniformly  in  N)  a continuous  function 

N 

2 

of  (x,y)  t J‘,  Let  us  then  define 

(5.2)  Y^tx.y)  = yn(x,x)  + yN(y,y)  - 2yN(x,y)  , V(x,y)eJ2. 

0 2 

It  follows  from  (5.1)  and  (5.2)  that  Yv,(x,y)  ^0,  V (x,y)  e J , and,  more- 

N 

over,  by  using  (2.6)-(2.8)  and  (2.14),  it  follows  by  some  standard  steps 
that  there  exists  a positive  constant  K(<°°) , depending  only  on  T and 
the  M.  in  (2.6)-(2.8),  such  that 

(5.3)  SNP  YN(X,y)  < Kly'xl  ’ v(x,y)cJ“  . 

Let  = [C^(x) , xcJ]}  be  a sequence  of  (independent)  Gaussian 

2 

functions  on  J,  where  F.yn(x)=0  and  EyN(x)YN(y)  = Y^U.y) , V (x,y)  «.  J . 

Then  E [ (y)  - ^(x) |4  = 2 (E [ CN (y)  - CN(x)]“)“  = 2[y^(x,v) ]" < 2K~(y-x)2, 

2 

V(x,y)  e J , so  that  by  the  Kolmogorov  existence  theorem,  for  every  N, 
belongs  to  the  space  C [ J ] , with  probability  1. 

Now,  for  every  N,  consider  the  sample  process  = {W  (x) , x-  J), 

where 

1s.4)  »N(«)  ■n’‘Mzn1Nx]-*n(n,]),  *<j, 

[s]  being  the  largest  integer  <s.  Then,  W belongs  to  the  space  l)[J], 
endowed  with  the  Skorokhod  J^-topology. 

Theorem  5.1.  Under  (2.6)-(2.8)  and  (2.14),  { W' . } and  {t}  are  oonOerqcnt- 

N N 

equivalent  in  law , in  the  J - topology  on  0[J). 
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Proof.  Wo  need  to  show  that  (.a)  the  finite  dimensional  distributions  of 
{ } are  convergent  equivalent  to  the  corresponding  ones  of  {£  },  an^ 

(b)  that  (W  } is  tight.  Now,  (a)  follows  readily  from  Theorem  4.1.  Also, 
by  (1.4)  and  (5.S),  W^(0)  =0,  with  probability  1,  V N.  Hence,  to  prove 
(b)  , it  suffices  to  show  that  for  every  e>0  and  n>0,  there  exists  a 
6:  0 < 6 < T and  an  interger  N^,  such  that  for  every  x c J and  N i N^, 


(5.5)  P{sup[|WN(y)  - h'N(x)  j : x > y > (x-5)  v 0|  > e}  < rpS/T  . 

^ [ N x 1 

Suppose  that  in  (5.4),  we  replace  ZN|N)  -4>N[Nx|  bY  sN|Nxj  * Xt  J>  and 
denote  the  resulting  process  by  W^.  Then,  proceeding  as  in  (3.9) -(5. 10) , 
it  follows  that  for  every  e1  >0, 


Hence,  it  suffices  to  prove  (5.5)  with  W replacing  W . Towards  this 

N N 

note  that 


5 ’ 7)  N (SNn'SNk)=N  tbNn-SNk)+N  (SNk  ‘SNk  1 * V k ? ° 1 


Since  {S.^ , B.„  ; k^l)  is  a martingale,  bv  (3.12),  (3.14)  and  (3.19) 
Nk  Nk 


insuring  that 


fylNx|  (n)  (n)  | 2 £ 

l'-k=l  1 Nk  l t Nk  'V  N[Nxl 


Nk 


J 


1 , V X ' .1),  we  are  in  a posi- 
tion to  use  Theorem  2 of  Scott  (1973)  and  this,  along  with  (2.13)  and  (2.141, 
implies  that  for  every  e>0  and  n>0,  there  exist  a <S:  0 < 5 < M and  an 
N(),  such  that  for  N -N(),  n=  |Nx],  x .1 


<$M~  < 1 , then  for  |n-k]  < SN, 


Also,  if  we  choose  <5(>0)  so  small  that 
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i-k)l  , ma*  p„(s)  i < 6M  < 1 , bv  (2.6).  Hence,  for  n k 2 (n-6N)  a o , we 
(lss'N  N J l 


obtain  from  (3.7)  that 


(5.9)  N (S^k  -S^R  ) = .Mgn(kji(YNi'QNi}  " tgn>k,i  (YNi  ,QNi 


•QvJl  . 


where 


(5.10)  gn  k . (a,b)  = N" 2a(l-e"(n  k1h) [e~kh(l+b)k  - be  kb(l+b)J  , 


1 < i < k • n • Nt 


Note  that  by  (2.6)-(2.7),  for  every  ns  Nt,  (2 . 15) - (2 . 1 7)  hold  with 

Mn  , = 0(N'1 *(n-k)N"'21™*N|aN(s)|)  = [0  (1 ) ] [ (n-k) /N]  , = N‘\n-k)-0(l) 

and  M r = N-2 (n-k) 2 • 0 ( 1 ) . Hence,  by  (2. 19) -(2. 10)  and  (5 . 9) - (5 . 10) , we  have 
N ,5 

(5.11)  E{[N''i(S|Jk)-S!Jk))|2}<M*[N'1(n-k)l2  , 


V k:  NT  - n ^ k > (n-  N)  v 0 , 


where  M*(<TO)  does  not  depend  on  6.  By  (5.11)  and  Theorem  12.2  of 
Billingsley  (1968,  p.  94),  we  conclude  that  for  every  n < TN , t < 00  , 


(5.12) 


i K-<”’ 


and  k*  does  not  depend  on  c and  6.  For  every  e>0,  n > 0 and  T < 110  , 
we  choose  6(>0)  so  small  that  <5  s ne“/2K*T,  so  that  the  right  hand  side 

of  (5.12)  is  < 'i n<5/T.  From  (5.8)  and  (5.12),  wo  obtain  that 

<5-W  r{n-"^M,N'  nS/T.  V NT  ' n l • In-  N>  . 0 . 

ami  this  completes  the  proof  of  (5.5)  (for  W ) . Q.l  .0. 
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6.  INVARIANCE  PRINCIPLE  FOR  THE  WAITING  TIME  PROCESS 


Wo  define  the  waiting  times  II,.  (t),  t JO  as  in  (1.5).  Note  that  here 

N 

all  the  a,,(s)  are  assumed  to  be  non -negative,  so  that  Z...  is  ^ in 
N Nk 

k(iO).  Mere  also  we  make  the  assumptions  (2.6)-(2.8)  as  well  as  the  con- 

- 1 V 

vention  (2.14)  i.e.,  N A„  ~ 1 , so  that  0 < A.,,  < A.2  ~ 1 . We  assume  that 

N.  " nil  N/ 


(6.1) 


1 im  inf  ^ , 
N-*~  AN1  A1 


> 0 . 


Note  that  bv  (2.14)  and  (2.7),  m‘lx  N 2 ] a. , ( s ) I = 0(1),  so  that  N 2|v..  |, 

E ssN  N Nk 

k ^ 1 are  all  uniformly  asymptotically  (as  N ■+  °°)  negligible.  Further,  by 

definition  Z s NA  j V n • 1,  so  that  in  (1.5),  we  are  only  interested  in 

the  domain  t < NA,  . Let  us  define  <b,,  , n > 0 as  in  (2.3)  and  introduce  the 
1 Nn 

sequence  = (a^(x) : 0 < x S NA}  by  letting 


(6.2) 


0 s x < NAj  . 


Note  that  by  (2.3)  and  (6.2),  cx^ ( x ) is  non-decreasing  and 
(6.3)  aNlx)  =Jx  VX)  = 

(6‘4)  aNU)  =cTx  = K(: 

Thus,  by  steps  similar  to  those  in  (2. 10) -(2. 1 1 ) , it  can  be  shown  that  under 
(2.6)-(2.8),  (2.14)  and  (6.1),  for  x = Nu,  0 < u *■  A.  , a'(Nu)  and  ot"(Nu)  are 

i N N 

continuous  functions  of  u and,  further. 


? ( , -aN(x)l’N(s) 

).  -iN(s)p  (s)e 

s=  1 


,-r  - 1 


or 


).  a (s)p  (s)e 
s=  1 


‘Vx1pN(sl 


1 


(6.5)  ct^(Nu)  =0  (1}  and  o^(Nu)  =0^(N  );  0 exact  order 


Let  us  also  define  Y,,(x,y)  as  in  (5.1)  and  set 

N 
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(6-6)  3“lNu)  = [yn(onINu)  , (Nu) ) ] [a^ (Nu) ] ^ , 0 < u < Aj  . 

Then,  note  that  by  ( (j . 5 1 , for  every  u • 1 0 , A ^ ")  and  fixed  v l j v { • K) 

\ -*  oo 


as 


(6.7) 


N'  2[aN(Nu  ♦ N\>)  - aN(Nu)  | 


= va^(Nu)  + *a  v“N  2ct!JtNu  + 0N  \>)  (0  < 0 < 1) 


va ' ( Nu ) + 0 ( N 5)  . 
N 


Further,  by  (6.2)  and  (1.5),  for  every  v and  ue  (0,Aj), 


(6.8) 


P{VNu)  >oN(Nu*N\)}  - P(Z  , < Nu} 

N 

1 \. 

- P{n”2IZ  1 -d)  1 1 < n"  2 1 Nu-d>  1 v 

1 Na.-CNu+NA/)  sNav.(Nu+N  2v)  1 4Nol. (Nu+N2v) 

N N N 

= P(W  lN  *a., (Nu+N*\>))  < -vl  . bv  (6.2), 

N N 


D 


_ i i 

where  ( • ) is  defined  by  (5.4),  and  by  (6.7),  N [a^(Nu+N'v)  -a^(Nu)  ] -*  0 
as  N *■  00  , V ut  (0,A  1.  Hence,  by  Theorem  5.1  (viz.,  (5.5)  |,  the  right  hand 
side  of  (6.8)  is  convergent  equivalent  to 


(6.0) 


P(W  (N~  a (Nu))  •-  -v) 
N N 


for  every  finite  v . 


On  the  other  hand,  for  every  finite  V and  u ( 0 . A ^ ) . by  (6.7)  and  (6.8), 

P{N~'2{ (I  (Nu)  -ol  (Nu)  | / P ( Nu)  ’v} 

IN  N N 

(6.10)  = P(UV1  (Nu) >a  ( Nu)  +N  (Nu)\> } 

N IN  IN 

= P(UN(Nti)>aN(Nii+N’2bN(Nu)v)/t^(Nii)+()(  1))} 

~ P UV  (N"  *«  ( Nu  ♦n\>P  ( Nu ) /a^ ( Nu ) +0 ( 1 I )'  -vg^Nul/a^Nu)  ♦ 0(N~'S)  ) 
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Now,  by  (5.1)  and  (0.4),  (6.6),  6 (Nu)/«'(Nu)  = Y.?(oi.,(Nu) , ot.(Nu)),  and 

by  (2.10)  and  (S.l),  it  is  0(1).  Hence,  by  the  convergence  equivalence  of 
(6.8)-(6.9),  the  right  hand  side  of  (6.10)  is  convergent  equivalent  to 

(6.11)  HWN(N  ^T^tuN)  )/y^(aN(Nu) , (^(Nu))  < -v} 

-V 

•*  /2ti  exp(-^t")dt  = ^ exp(- '*  t“)dt  , 

-oo 

by  Theorem  5.1.  Hence,  we  conclude  that 

(6.12)  L(N'l-[UN(Nu)-aN(Nu)]/eN(Nu))  ->  N(0,1)  , Yu  (O.Aj)  . 

l.et  J*  = [0,T*]  for  some  0 < T*  < A^  and  consider  a sequence  of  sto- 
chastic processes  W*  = (W*(u),  u<  J*),  N > 1 , where 

(6.15)  W*(u)  = N_  2{l)  (Nu) -a.,(Nu)  }/a’(Nu)  , 0 < u < T*  . 

N N N N 

Let  us  define  >)  as  in  (5.1)  and  ol.(.)  as  in  (6.2),  and  let 

(6.14)  YjJ(u.v)  = Yn(J-  ^(Nu)  > j^VNV))’ 

Since  a,,(x)  is  a monotonic  transformation  of  x,  defining  (r  } as  in 
N N 

after  (5.5),  by  transformation  of  the  t i me -parameter , we  obtain  a sequence 
{r,*}  of  Gaussian  functions  where  A*  = (r,*(u),  u < .1*}  with  F.r,*(u)  = 0 
and  Hr,*  (u)A*  (v)  = y*(u,v),  V u,v<  .1*. 

Theorem  6.1.  Under  (2. 6) -(2. 8),  (2.14)  arul  (6.1),  for  ,:verq  T*<A,,  (W*) 
and  {r,*}  arc  convergent  equivalent  in  law. 

Proof.  For  every  given  m('l)  and  0 • iij  < ...  < u s T* , virtually  repeating 


the  steps  (6. 8) - (6 . 1 1 ) , but  working  with  the  vector  case,  it  follows  that 
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(0.15) 


'W ■ ' IW r-NU,m' 1 


Also,  recall  that  by  (1.5) 


(6. lb) 


v t ^ Z + Y V t > 0 

NUN(t)  NUN(t)  NUN(t)+l  ’ 


where  by  (2.7)  and  (2.14),  j^l  s !<s<N'aN(s)  • = °tN')<  Hcnce* 


(b. 17) 


n*4!  sup  |N_1Z  -ulj  2 0 

\u. J*1  NUn(Nu)  '/ 


3S  N 00 


On  the  other  hand,  by  Theorem  5.1  and  (b.2), 

P 


(6.18) 


SU.P*  | N_1Z  .-  u|  ^ 0 , as  N 
u-  J 1 Not.,  (u)  1 


By  (6.5),  (6.17)  and  (6.18),  it  follows  by  some  standard  steps  that 


16. 19) 


u*>-Vnu)  -N'1cin(Nu)|  2 o 


Having  proved  this,  we  may  proceed  along  the  lines  of  the  proof  of  Theorem 
17.3  of  Billingsley  (1968,  p.  149)  and  show  that  the  weak  convergent  equiva- 
lence of  {W  ) and  {£.,}  in  Theorem  5.1  implies  the  same  for  {W*}  and 
N N N 

U*}.  Q.E.n. 


som):  com: i.i  id  i no  remarks 


Parallel  to  (6.12),  Rosen  (1970)  has  obtained  the  asymptotic  normality 

along  with  the  asymptotic  equivalence  of  a (Nu)  and  llJ^(Nu)  as  well  as 

of  B“(Nu)  and  Var  [If,  (Nu)  1 . However,  his  conditions  (2.7)-(2.8)  arc  some- 
N N 

what  more  restrictive  than  ours  and  our  Theorem  5.1  provides  us  with  Theorem 
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6.1  under  no  entra  conditions  — Rosen's  approach  presumably  encouters  consi- 
derable difficulties  in  this  respect.  Secondly,  in  his  Theorems  2 and  3, 

Rosen  (19091  has  studied  the  convergence  of  f.d.d.'s  of  {W,,}  to  those  of 

N 

under  additional  conditions  [viz.,  his  (5,4),  (5 . 10) j which  insures 

~> 

that  YN(x,y)  -*•  ytx.y)  as  N ->  00  , V (x,y)  ■ J , Under  his  setup,  using 
his  Lemma  3.17,  one  can  also  prove  the  tightness  of  {W^}  (by  using  Theorem 
12.2  of  Billingsley  (1968))  provided  one  assumes  (in  our  notations)  that  for 
some  r>2,  A^/A^  = 0(1)  , V N iN^.  In  our  approach,  these  additional 

conditions  do  not  appear  to  be  necessary.  Moreover,  contrasted  with  his 
Hilbert  space  approach,  the  present  one  appears  to  be  more  elementary  too. 
Finally,  through  the  pioneering  work  of  Rosen  (1972a, b),  the  coupon  collec- 
tor's problem  occupies  a prominent  place  in  the  development  of  the  asymptotic 
theory  of  finite  population  sampling  (without  replacement)  with  varying  pro- 
babilities. It  is  hoped  that  the  results  of  the  present  paper  will  lead  to 
more  work  in  this  potential  area. 
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